Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Jan 19, 2025
@github-actions github-actions bot requested review from a team as code owners January 19, 2025 04:21
@github-actions github-actions bot requested review from cimi, sezen-datadog, smola and tonyredondo and removed request for a team January 19, 2025 04:21
@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1737379004 1737379377
end_time 2025-01-20T13:18:01 2025-01-20T13:24:15
git_branch master ci/update-gradle-dependencies-20250119
git_commit_sha a69247f 64d72b8
start_time 2025-01-20T13:16:45 2025-01-20T13:22:58
See matching parameters
Baseline Candidate
ci_job_id 772678779 772678779
ci_pipeline_id 53474342 53474342
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1737378397 1737378397

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-29703.852ns; +29151.058ns] or [-10.834%; +10.632%]
unstable
[-43.860µs; +40.056µs] or [-13.915%; +12.708%]
unstable
[-59.148µs; +49.888µs] or [-17.856%; +15.060%]
unstable
[-124.499µs; +93.249µs] or [-20.788%; +15.570%]
unstable
[-168.336op/s; +101.736op/s] or [-6.481%; +3.917%]
scenario:basic same same same unstable
[-54.713µs; +27.816µs] or [-10.270%; +5.221%]
unstable
[-185.718op/s; +185.718op/s] or [-7.429%; +7.429%]
scenario:loop unsure
[-28.432µs; -8.170µs] or [-0.284%; -0.082%]
same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (315.197 µs) : 270, 361
.   : milestone, 315,
basic (310.548 µs) : 300, 321
.   : milestone, 311,
loop (10.166 ms) : 10127, 10205
.   : milestone, 10166,
section candidate
noprobe (313.295 µs) : 280, 347
.   : milestone, 313,
basic (308.687 µs) : 300, 317
.   : milestone, 309,
loop (10.137 ms) : 10105, 10170
.   : milestone, 10137,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 315.197 µs [269.574 µs, 360.821 µs]
basic 310.548 µs [299.603 µs, 321.492 µs]
loop 10.166 ms [10.127 ms, 10.205 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 313.295 µs [279.876 µs, 346.714 µs]
basic 308.687 µs [299.902 µs, 317.471 µs]
loop 10.137 ms [10.105 ms, 10.17 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737373742 1737378397
git_commit_sha a69247f 64d72b8
release_version 1.46.0-SNAPSHOT~a69247f0aa 1.46.0-SNAPSHOT~64d72b8b39
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737380751 1737380751
ci_job_id 772678773 772678773
ci_pipeline_id 53474342 53474342
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054672
Total [baseline] (8.617 s) : 0, 8617359
Agent [candidate] (1.056 s) : 0, 1056109
Total [candidate] (8.616 s) : 0, 8616099
section iast
Agent [baseline] (1.184 s) : 0, 1183674
Total [baseline] (9.2 s) : 0, 9200402
Agent [candidate] (1.186 s) : 0, 1186283
Total [candidate] (9.247 s) : 0, 9246959
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1182866
Total [baseline] (9.147 s) : 0, 9147214
Agent [candidate] (1.181 s) : 0, 1181010
Total [candidate] (9.204 s) : 0, 9203964
section iast_TELEMETRY_OFF
Agent [baseline] (1.178 s) : 0, 1178099
Total [baseline] (9.178 s) : 0, 9178161
Agent [candidate] (1.182 s) : 0, 1181786
Total [candidate] (9.189 s) : 0, 9188562
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.184 s 129.002 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 128.194 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.178 s 123.428 ms (11.7%)
Total tracing 8.617 s -
Total iast 9.2 s 583.043 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.147 s 529.855 ms (6.1%)
Total iast_TELEMETRY_OFF 9.178 s 560.801 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.186 s 130.174 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.181 s 124.901 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.182 s 125.677 ms (11.9%)
Total tracing 8.616 s -
Total iast 9.247 s 630.86 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.204 s 587.865 ms (6.8%)
Total iast_TELEMETRY_OFF 9.189 s 572.463 ms (6.6%)
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.318 ms) : 0, 713318
BytebuddyAgent [candidate] (713.341 ms) : 0, 713341
GlobalTracer [baseline] (255.156 ms) : 0, 255156
GlobalTracer [candidate] (255.714 ms) : 0, 255714
AppSec [baseline] (56.17 ms) : 0, 56170
AppSec [candidate] (55.552 ms) : 0, 55552
Remote Config [baseline] (734.339 µs) : 0, 734
Remote Config [candidate] (724.308 µs) : 0, 724
Telemetry [baseline] (14.323 ms) : 0, 14323
Telemetry [candidate] (15.731 ms) : 0, 15731
section iast
BytebuddyAgent [baseline] (832.497 ms) : 0, 832497
BytebuddyAgent [candidate] (834.321 ms) : 0, 834321
GlobalTracer [baseline] (246.778 ms) : 0, 246778
GlobalTracer [candidate] (247.276 ms) : 0, 247276
AppSec [baseline] (58.254 ms) : 0, 58254
AppSec [candidate] (58.274 ms) : 0, 58274
IAST [baseline] (21.67 ms) : 0, 21670
IAST [candidate] (21.782 ms) : 0, 21782
Remote Config [baseline] (675.545 µs) : 0, 676
Remote Config [candidate] (676.902 µs) : 0, 677
Telemetry [baseline] (8.859 ms) : 0, 8859
Telemetry [candidate] (8.875 ms) : 0, 8875
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (831.873 ms) : 0, 831873
BytebuddyAgent [candidate] (830.78 ms) : 0, 830780
GlobalTracer [baseline] (246.73 ms) : 0, 246730
GlobalTracer [candidate] (246.399 ms) : 0, 246399
AppSec [baseline] (58.352 ms) : 0, 58352
AppSec [candidate] (57.979 ms) : 0, 57979
IAST [baseline] (21.455 ms) : 0, 21455
IAST [candidate] (21.53 ms) : 0, 21530
Remote Config [baseline] (671.078 µs) : 0, 671
Remote Config [candidate] (658.735 µs) : 0, 659
Telemetry [baseline] (8.839 ms) : 0, 8839
Telemetry [candidate] (8.732 ms) : 0, 8732
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (828.098 ms) : 0, 828098
BytebuddyAgent [candidate] (831.122 ms) : 0, 831122
GlobalTracer [baseline] (246.668 ms) : 0, 246668
GlobalTracer [candidate] (247.537 ms) : 0, 247537
AppSec [baseline] (58.057 ms) : 0, 58057
AppSec [candidate] (58.16 ms) : 0, 58160
IAST [baseline] (20.93 ms) : 0, 20930
IAST [candidate] (20.687 ms) : 0, 20687
Remote Config [baseline] (664.472 µs) : 0, 664
Remote Config [candidate] (663.81 µs) : 0, 664
Telemetry [baseline] (8.71 ms) : 0, 8710
Telemetry [candidate] (8.573 ms) : 0, 8573
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052203
Total [baseline] (10.434 s) : 0, 10434245
Agent [candidate] (1.055 s) : 0, 1054808
Total [candidate] (10.507 s) : 0, 10507205
section appsec
Agent [baseline] (1.191 s) : 0, 1190767
Total [baseline] (10.695 s) : 0, 10694872
Agent [candidate] (1.191 s) : 0, 1190803
Total [candidate] (10.711 s) : 0, 10711438
section iast
Agent [baseline] (1.185 s) : 0, 1184893
Total [baseline] (10.979 s) : 0, 10979096
Agent [candidate] (1.185 s) : 0, 1185041
Total [candidate] (10.97 s) : 0, 10969933
section profiling
Agent [baseline] (1.252 s) : 0, 1252035
Total [baseline] (10.843 s) : 0, 10843319
Agent [candidate] (1.253 s) : 0, 1252857
Total [candidate] (10.806 s) : 0, 10805796
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.191 s 138.564 ms (13.2%)
Agent iast 1.185 s 132.689 ms (12.6%)
Agent profiling 1.252 s 199.832 ms (19.0%)
Total tracing 10.434 s -
Total appsec 10.695 s 260.627 ms (2.5%)
Total iast 10.979 s 544.851 ms (5.2%)
Total profiling 10.843 s 409.073 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.191 s 135.995 ms (12.9%)
Agent iast 1.185 s 130.233 ms (12.3%)
Agent profiling 1.253 s 198.049 ms (18.8%)
Total tracing 10.507 s -
Total appsec 10.711 s 204.234 ms (1.9%)
Total iast 10.97 s 462.728 ms (4.4%)
Total profiling 10.806 s 298.591 ms (2.8%)
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (712.286 ms) : 0, 712286
BytebuddyAgent [candidate] (713.688 ms) : 0, 713688
GlobalTracer [baseline] (255.17 ms) : 0, 255170
GlobalTracer [candidate] (254.916 ms) : 0, 254916
AppSec [baseline] (56.273 ms) : 0, 56273
AppSec [candidate] (56.242 ms) : 0, 56242
Remote Config [baseline] (728.01 µs) : 0, 728
Remote Config [candidate] (734.178 µs) : 0, 734
Telemetry [baseline] (12.802 ms) : 0, 12802
Telemetry [candidate] (14.223 ms) : 0, 14223
section appsec
BytebuddyAgent [baseline] (732.85 ms) : 0, 732850
BytebuddyAgent [candidate] (732.162 ms) : 0, 732162
GlobalTracer [baseline] (253.593 ms) : 0, 253593
GlobalTracer [candidate] (253.47 ms) : 0, 253470
AppSec [baseline] (170.814 ms) : 0, 170814
AppSec [candidate] (171.611 ms) : 0, 171611
IAST [baseline] (19.38 ms) : 0, 19380
IAST [candidate] (19.416 ms) : 0, 19416
Remote Config [baseline] (660.363 µs) : 0, 660
Remote Config [candidate] (661.582 µs) : 0, 662
Telemetry [baseline] (8.162 ms) : 0, 8162
Telemetry [candidate] (8.195 ms) : 0, 8195
section iast
BytebuddyAgent [baseline] (833.073 ms) : 0, 833073
BytebuddyAgent [candidate] (833.539 ms) : 0, 833539
GlobalTracer [baseline] (247.057 ms) : 0, 247057
GlobalTracer [candidate] (247.061 ms) : 0, 247061
AppSec [baseline] (58.517 ms) : 0, 58517
AppSec [candidate] (58.317 ms) : 0, 58317
IAST [baseline] (21.687 ms) : 0, 21687
IAST [candidate] (21.637 ms) : 0, 21637
Remote Config [baseline] (686.136 µs) : 0, 686
Remote Config [candidate] (655.015 µs) : 0, 655
Telemetry [baseline] (8.89 ms) : 0, 8890
Telemetry [candidate] (8.815 ms) : 0, 8815
section profiling
BytebuddyAgent [baseline] (701.547 ms) : 0, 701547
BytebuddyAgent [candidate] (702.871 ms) : 0, 702871
GlobalTracer [baseline] (349.201 ms) : 0, 349201
GlobalTracer [candidate] (349.411 ms) : 0, 349411
AppSec [baseline] (54.886 ms) : 0, 54886
AppSec [candidate] (53.947 ms) : 0, 53947
Remote Config [baseline] (694.611 µs) : 0, 695
Remote Config [candidate] (700.34 µs) : 0, 700
Telemetry [baseline] (8.739 ms) : 0, 8739
Telemetry [candidate] (8.734 ms) : 0, 8734
ProfilingAgent [baseline] (95.255 ms) : 0, 95255
ProfilingAgent [candidate] (95.381 ms) : 0, 95381
Profiling [baseline] (95.279 ms) : 0, 95279
Profiling [candidate] (95.406 ms) : 0, 95406
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-20T13:15:51 2025-01-20T13:22:56
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737373742 1737378397
git_commit_sha a69247f 64d72b8
release_version 1.46.0-SNAPSHOT~a69247f0aa 1.46.0-SNAPSHOT~64d72b8b39
start_time 2025-01-20T13:15:37 2025-01-20T13:22:42
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737379736 1737379736
ci_job_id 772678774 772678774
ci_pipeline_id 53474342 53474342
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1375
.   : milestone, 1355,
appsec (1.764 ms) : 1741, 1787
.   : milestone, 1764,
appsec_no_iast (1.74 ms) : 1715, 1765
.   : milestone, 1740,
iast (1.517 ms) : 1494, 1541
.   : milestone, 1517,
profiling (1.526 ms) : 1502, 1549
.   : milestone, 1526,
tracing (1.483 ms) : 1458, 1508
.   : milestone, 1483,
section candidate
no_agent (1.349 ms) : 1329, 1370
.   : milestone, 1349,
appsec (1.753 ms) : 1728, 1777
.   : milestone, 1753,
appsec_no_iast (1.761 ms) : 1738, 1784
.   : milestone, 1761,
iast (1.515 ms) : 1491, 1540
.   : milestone, 1515,
profiling (1.562 ms) : 1538, 1587
.   : milestone, 1562,
tracing (1.494 ms) : 1469, 1519
.   : milestone, 1494,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.375 ms] -
appsec 1.764 ms [1.741 ms, 1.787 ms] 409.021 µs (30.2%)
appsec_no_iast 1.74 ms [1.715 ms, 1.765 ms] 385.043 µs (28.4%)
iast 1.517 ms [1.494 ms, 1.541 ms] 162.298 µs (12.0%)
profiling 1.526 ms [1.502 ms, 1.549 ms] 170.548 µs (12.6%)
tracing 1.483 ms [1.458 ms, 1.508 ms] 127.734 µs (9.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.329 ms, 1.37 ms] -
appsec 1.753 ms [1.728 ms, 1.777 ms] 403.196 µs (29.9%)
appsec_no_iast 1.761 ms [1.738 ms, 1.784 ms] 411.562 µs (30.5%)
iast 1.515 ms [1.491 ms, 1.54 ms] 166.086 µs (12.3%)
profiling 1.562 ms [1.538 ms, 1.587 ms] 212.931 µs (15.8%)
tracing 1.494 ms [1.469 ms, 1.519 ms] 144.899 µs (10.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.989 µs) : 360, 400
.   : milestone, 380,
iast (503.17 µs) : 482, 525
.   : milestone, 503,
iast_FULL (746.748 µs) : 725, 769
.   : milestone, 747,
iast_GLOBAL (553.713 µs) : 532, 575
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (514.901 µs) : 493, 537
.   : milestone, 515,
iast_INACTIVE (461.008 µs) : 439, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (495.026 µs) : 473, 517
.   : milestone, 495,
tracing (455.462 µs) : 434, 477
.   : milestone, 455,
section candidate
no_agent (379.157 µs) : 359, 399
.   : milestone, 379,
iast (497.816 µs) : 474, 521
.   : milestone, 498,
iast_FULL (741.136 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (553.797 µs) : 532, 576
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (504.951 µs) : 483, 527
.   : milestone, 505,
iast_INACTIVE (470.957 µs) : 448, 494
.   : milestone, 471,
iast_TELEMETRY_OFF (493.893 µs) : 472, 516
.   : milestone, 494,
tracing (451.761 µs) : 431, 473
.   : milestone, 452,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.989 µs [360.421 µs, 399.556 µs] -
iast 503.17 µs [481.673 µs, 524.667 µs] 123.182 µs (32.4%)
iast_FULL 746.748 µs [724.617 µs, 768.878 µs] 366.759 µs (96.5%)
iast_GLOBAL 553.713 µs [532.088 µs, 575.338 µs] 173.724 µs (45.7%)
iast_HARDCODED_SECRET_DISABLED 514.901 µs [493.037 µs, 536.765 µs] 134.912 µs (35.5%)
iast_INACTIVE 461.008 µs [439.406 µs, 482.609 µs] 81.019 µs (21.3%)
iast_TELEMETRY_OFF 495.026 µs [473.307 µs, 516.745 µs] 115.037 µs (30.3%)
tracing 455.462 µs [434.149 µs, 476.775 µs] 75.473 µs (19.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.157 µs [358.939 µs, 399.376 µs] -
iast 497.816 µs [474.177 µs, 521.456 µs] 118.659 µs (31.3%)
iast_FULL 741.136 µs [719.13 µs, 763.142 µs] 361.979 µs (95.5%)
iast_GLOBAL 553.797 µs [531.592 µs, 576.002 µs] 174.64 µs (46.1%)
iast_HARDCODED_SECRET_DISABLED 504.951 µs [483.391 µs, 526.51 µs] 125.794 µs (33.2%)
iast_INACTIVE 470.957 µs [447.542 µs, 494.372 µs] 91.8 µs (24.2%)
iast_TELEMETRY_OFF 493.893 µs [471.978 µs, 515.808 µs] 114.736 µs (30.3%)
tracing 451.761 µs [430.537 µs, 472.986 µs] 72.604 µs (19.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737373742 1737378397
git_commit_sha a69247f 64d72b8
release_version 1.46.0-SNAPSHOT~a69247f0aa 1.46.0-SNAPSHOT~64d72b8b39
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737380572 1737380572
ci_job_id 772678775 772678775
ci_pipeline_id 53474342 53474342
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.474 s) : 14474000, 14474000
.   : milestone, 14474000,
appsec (14.821 s) : 14821000, 14821000
.   : milestone, 14821000,
iast (17.974 s) : 17974000, 17974000
.   : milestone, 17974000,
iast_GLOBAL (17.297 s) : 17297000, 17297000
.   : milestone, 17297000,
profiling (14.433 s) : 14433000, 14433000
.   : milestone, 14433000,
tracing (14.332 s) : 14332000, 14332000
.   : milestone, 14332000,
section candidate
no_agent (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,
appsec (14.416 s) : 14416000, 14416000
.   : milestone, 14416000,
iast (18.329 s) : 18329000, 18329000
.   : milestone, 18329000,
iast_GLOBAL (17.556 s) : 17556000, 17556000
.   : milestone, 17556000,
profiling (14.544 s) : 14544000, 14544000
.   : milestone, 14544000,
tracing (14.862 s) : 14862000, 14862000
.   : milestone, 14862000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.474 s [14.474 s, 14.474 s] -
appsec 14.821 s [14.821 s, 14.821 s] 347.0 ms (2.4%)
iast 17.974 s [17.974 s, 17.974 s] 3.5 s (24.2%)
iast_GLOBAL 17.297 s [17.297 s, 17.297 s] 2.823 s (19.5%)
profiling 14.433 s [14.433 s, 14.433 s] -41.0 ms (-0.3%)
tracing 14.332 s [14.332 s, 14.332 s] -142.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.103 s [15.103 s, 15.103 s] -
appsec 14.416 s [14.416 s, 14.416 s] -687.0 ms (-4.5%)
iast 18.329 s [18.329 s, 18.329 s] 3.226 s (21.4%)
iast_GLOBAL 17.556 s [17.556 s, 17.556 s] 2.453 s (16.2%)
profiling 14.544 s [14.544 s, 14.544 s] -559.0 ms (-3.7%)
tracing 14.862 s [14.862 s, 14.862 s] -241.0 ms (-1.6%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~64d72b8b39, baseline=1.46.0-SNAPSHOT~a69247f0aa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1474, 1498
.   : milestone, 1486,
appsec (2.65 ms) : 2579, 2721
.   : milestone, 2650,
iast (2.429 ms) : 2342, 2516
.   : milestone, 2429,
iast_GLOBAL (2.474 ms) : 2386, 2561
.   : milestone, 2474,
profiling (2.284 ms) : 2210, 2359
.   : milestone, 2284,
tracing (2.236 ms) : 2166, 2306
.   : milestone, 2236,
section candidate
no_agent (1.484 ms) : 1472, 1496
.   : milestone, 1484,
appsec (2.647 ms) : 2576, 2718
.   : milestone, 2647,
iast (2.418 ms) : 2331, 2505
.   : milestone, 2418,
iast_GLOBAL (2.478 ms) : 2391, 2566
.   : milestone, 2478,
profiling (2.757 ms) : 2559, 2955
.   : milestone, 2757,
tracing (2.241 ms) : 2171, 2311
.   : milestone, 2241,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.474 ms, 1.498 ms] -
appsec 2.65 ms [2.579 ms, 2.721 ms] 1.163 ms (78.3%)
iast 2.429 ms [2.342 ms, 2.516 ms] 942.956 µs (63.4%)
iast_GLOBAL 2.474 ms [2.386 ms, 2.561 ms] 987.514 µs (66.4%)
profiling 2.284 ms [2.21 ms, 2.359 ms] 798.202 µs (53.7%)
tracing 2.236 ms [2.166 ms, 2.306 ms] 749.642 µs (50.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.496 ms] -
appsec 2.647 ms [2.576 ms, 2.718 ms] 1.163 ms (78.4%)
iast 2.418 ms [2.331 ms, 2.505 ms] 934.406 µs (63.0%)
iast_GLOBAL 2.478 ms [2.391 ms, 2.566 ms] 994.322 µs (67.0%)
profiling 2.757 ms [2.559 ms, 2.955 ms] 1.273 ms (85.8%)
tracing 2.241 ms [2.171 ms, 2.311 ms] 757.025 µs (51.0%)

@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737371099 1737371387
git_commit_sha 4ce36ea 822e1f3
See matching parameters
Baseline Candidate
ci_job_date 1737372617 1737372617
ci_job_id 772517299 772517299
ci_pipeline_id 53462986 53462986
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jan 19, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250119
git_commit_date 1737371099 1737371387
git_commit_sha 4ce36ea 822e1f3
See matching parameters
Baseline Candidate
ci_job_date 1737372635 1737372635
ci_job_id 772517301 772517301
ci_pipeline_id 53462986 53462986
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[+852.909op/s; +8086.924op/s] or [+0.494%; +4.683%]

This was referenced Jan 20, 2025
@amarziali amarziali enabled auto-merge (squash) January 20, 2025 11:12
@amarziali amarziali added comp: api Tracer public API and removed comp: api Tracer public API labels Jan 20, 2025
@amarziali amarziali merged commit ea4856f into master Jan 20, 2025
177 of 179 checks passed
@amarziali amarziali deleted the ci/update-gradle-dependencies-20250119 branch January 20, 2025 13:58
@github-actions github-actions bot added this to the 1.46.0 milestone Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants